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(57) Abstract 

A configurable hardware system for implementing an algorithmic language program, including a programmable logic de- 
vice (PLD) (1 1) a hardware resource connectible to the PLD (e.g. 13), and a programmable connection (e.g. 58), all of which may 
be configured as a module or distributed processing units (DPU) (80). The hardware resource may include a serial processing de- 
vice such as a DSP (28), a PLD (1 1), a memory device (27), or a CPU. An extensible processing unit (EPU) can be built out oi 
multiple DPUs, each connected to other modules by one or more of several buses. In addition, a method is provided tor translat- 
ing source code (201) in an algorithmic language into a configuration file (207, 208, 209) for implementation on one or more 
DPUs. The method includes four sequential phases of translation: a tokenizing phase, a logical mapping phase, a logic optimiza- 
tion phase, and a device specific mapping phase. 
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SYSTEM FOR COMPILING 
5 ALGORITHMIC LANGUAGE SOURCE CODE INTO HARDWARE 

Field of the Invention 

This invention relates to a system of programmable logic devices (PLDs) for 
implementing a program which traditionally has been software implemented on a 
10 general purpose computer but now can be implemented in hardware. This invention 
also relates to a method of translating a source code program in an algorithmic 
language into a hardware description suitable for running on one or more 
programmable logic devices. 

15 Background of the Invention 

The general purpose computer was developed by at least the 1940s as the 
ENIAC machine at the University of Illinois. Numerous developments lead to 
.semiconductor-based computers, then central-processing units (CPUs) on a chip such 
as the early Intel 4040 or the more recent Intel 486, Motorola 68040, AMD 29000, 

20 and many other CPUs. A general purpose computer is designed to implement 
instructions one at a time according to a program loaded into the CPU or, more 
often, available in connected memory, usually some form of random access memory 
(RAM). 

25 A circuit specifically designed to process selected inputs and outputs can be 

designed to be much faster than a general purpose computer when processing the 
same inputs and outputs. Many products made today include an application specific 
integrated circuit (ASIC) which is optimized for a particular application. Such a 
circuit cannot be used for other applications, however, and it requires considerable 

30 expense and effort to design and build an ASIC. 

To design a typical ASIC, an engineer begins with a specification which 
includes what the circuit should do, what I/O is available and what processing is 
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required. An engineer must develop a design, program, flow chart, or logic flow and 
then design a circuit to implement the specification. This typically involves (1) 
analyzing the internal logic of the design, (2) converting the logic to Boolean 
functions which can be implemented in hardware logic blocks, (3) developing a 
5 schematic diagram and net list to configure and connect the logic blocks, then (4) 
implementing the circuit. There are a number of computerized tools available to 
assist an engineer with this process, including simulation of portions or all of a 
design, designing and checking schematics and netlists, and laying out the final ASIC, 
typically a VLSI device. Finally, a semiconductor device is created and the part can 

10 be tested. If the part does not perform as expected or if the specification changes, 
some or all of this process must be repeated and a new, revised ASIC must be 
designed and created until an acceptable part can be made which meets or 
approximates the specification. The entire design process is very time consuming and 
requires the efforts of several engineers and assistants. It is difficult to predict 

15 exactly what the final part will do once it is finally manufactured and if the part does 
not perform as expected, a new part must be designed and manufactured, requiring 
more time, resources and money. 

There are several alternatives to ASICs which may provide a solution when 
20 balancing cost, number of units to be made, performance, and other considerations. 
Field Programmable Gate Arrays (FPGAs) are high density ASICs that provide a 
number of logic resources but are designed to be configurable by a user. FPGAs can 
be configured in a short amount of time and provide faster performance than a 
general purpose computer, although generally not as fast as a fully customized circuit, 
25 and are available at moderate cost. FPGAs can be manufactured in high volume, 

reducing cost, since each user can select a unique configuration to run on the standard 
FPGA. The configuration of a part can be changed repeatedly, allowing for minor or 
even total revisions and specification changes. Other advantages of a configurable, 
standard part are: faster time implement a specification and deliver a functional unit 
30 to market, lower inventory risks, easy design changes, faster delivery, and 

availability of second sources. The programmable nature of the FPGA allows a 
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finished, commercial product to be revised in the field to incorporate improvements 
or enhancements to the specification or finished product. 

A gate array allows higher gate densities than an FPGA plus custom circuit 
5 design options but requires that the user design a custom interconnection for the gate 
array and requires manufacturing a unique part and may require one or more 
revisions if the specification was not right or if it changes. The user must design or 
obtain masks for a small number of layers which are fabricated on top of a standard 
gate array. The cost is less than for fully custom Ics or standard cell devices. 

10 

One significant development in circuit design is a series of 
programmable logic devices (PLDs) such as the Xilinx XC-3000 Logic Cell Array 
Family. Other manufacturers are beginning to make other programmable logic 
devices which offer similar resources and functionality. A typical device includes 

15 many configurable logic blocks (CLBs) each of which can be configured to apply 
selected Boolean functions to the available inputs and outputs. One type of CLB 
includes five logic inputs, a direct data-in line, clock lines, reset, and two outputs. 
The device also includes input/output blocks, each of which can be configured 
independently to be an input, an output, or a bidirectional channel with three-state 

20 control. Typically, each or even every pin on the device is connected to such an I/O 
block, allowing considerable flexibility. Finally, the device is rich in interconnect 
lines, allowing almost any two pins on the chip to be connected. Any of these lines 
can be connected elsewhere on the device, allowing significant flexibility. Modern 
devices such as the Xilinx XC 3000 series include the XC 3020 with 2000 gates 

25 through the XC 3090 9,000 gates. The XC 4000 series includes the XC 4020 with 
20,000 gates. 

To aid the designer, Xilinx can provide software to convert the output of a 
circuit simulator or schematic editor into Xilinx netlist file (XNF) commands which in 
30 turn can be loaded onto the FPGA to configure it. The typical input for the design is 
a schematic editor, including standard CAE software such as futureNet, Schema, 

. 3 - 
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OrCAD, VTEWlogic, Mentor or Valid. Xilinx provides programmable gate array 
libraries to permit design entry using Boolean equations or standard TTL functions. 
Xilinx design implementation software converts schematic netlists and Boolean 
equations into efficient designs for programmable gate arrays. Xilinx also provides 
5 verification tools to allow simulation, in-circuit design verification and testing on an 
actual, operating part. 

There are several hardware description languages which can be used to design 
or configure PALs, PLAs or FPGAs. Two such languages are HDL and ABLE. 
10 Cross-compilers are available to convert PALASM, HDL or ABLE code into XNF or 
into code suitable for configuring other manufacturer's devices. 

An enormous quantity of software is available today to run on general purpose 
computers. Essentially all of that software was originally created in a high level 
15 language such as C, PASCAL, COBOL or FORTRAN. A compiler can translate 
instructions in a high level language into machine code that will run on a specified 
general purpose computer or class of computers. To date, no one has developed a 
method of translating software-oriented languages to run as a hardware configuration 
on an FPGA or in fact on any other hardware-based device. 

20 

Other recent products have been introduced by Aptix, Mentor Graphics and 
Quickturn. See Mohsen, USPN 5,077,451 (assigned to Aptix Corporation), Butts, et 
aL, USPN 5,036,473 (assigned to Mentor Graphics Corporation), and Sample et al, 
USPN 5,109,353 (assigned to Quickturn Systems, Incorporated). These references 
25 . provide background for the present invention and related technologies. 

Others have attempted to partition logical functions over multiple PLDs but 
these efforts have not provided a true, full function implementation of algorithmic 
source code. McDermith et al, USPN 5,140,526 (assigned to Mine Incorporated), 
30 describe an automated system for partitioning a set of Boolean logic equations onto 
PLDs by comparing what resources are required to implement the logic equations 
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with information on what PLD devices are commercially available that have the 
capability to implement the logic equations, then evaluating the cost of any optional 
solutions. The disclosure focuses on part selection and does not disclose how logic is 
actually to be partitioned across multiple devices. 

5 

A computer program typically includes data gathering, data comparison and 
data output steps, often with many branch points. The principles of programming are 
well known in the art. A programmer usually begins with a high level perspective on 
what a program should do and how it should execute the program. The programmer 
10 must consider what machine will run the program and how to convert the desired 

program from an idea in the programmer's head to a functional program running on 
the target machine. Ultimately, a typical program on a general purpose computer is 
written in or converted by a compiler to machine code. 

15 A programmer will usually write in a high level language to facilitate 

organizing and coding the program. Using a high level language like the C language, 
a programmer can control almost any function of the computer. This control is 
limited, however, to operations accessible by the computer. In addition, the 
programmer must work within the constraints of the physical system and generally 

20 cannot add to, remove or alter the configuration of computer components, the 

resources available, how the resources are connected, or other physical attributes of 
the computer. 

In contrast, a special purpose computer can be designed to provide specific 
25 results for a range of expected inputs. Examples include controllers for household 
appliances, automobile systems control, and sophisticated industrial applications. 
Many such special purpose computers are designed into a wide range of commercial 
products, generally based on an ASIC. Programming an ASIC begins with a high 
level description of the program, but the program must be implemented by selecting a 
30 series of gates and circuits to achieve the programmer's goals. This usually involves 
converting the high level description into a logical description which can be 
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implemented in hardware. Many values are handled as specific signals which 
typically originate in one circuit then are carried by a "wire" to another circuit where 
the information will be used. A typical signal is created to provide for a single 
logical event or combination which may never or rarely occur in real life, but must 
5 be considered and provided for. Each such signal must be designed into the ASIC as 
one or several gates and connections. A complex program may require many such 
signals, and can consume a large portion of valuable, available circuit area and 
resources. A reconfigurable device could allocate resources for signals only as 
needed or when there is a high probability that the signal will be needed, dramatically 
10 reducing the resources that must be committed to a device. 

Programming a typical ASIC circuit is not easy but there are many tools 
available to help a programmer design and implement a circuit. Most programmers 
use silicon compilers, computer assisted engineering tools to design schematics which 

15 will perform the desired functions. An ASIC must be built to be tested, although 

many parts can be simulated with some accuracy. Almost any ASIC design requires 
revisions, which means making more parts, which is time consuming and expensive. 
A reconfigurable equivalent part can be incorporated in a design, tested, and modified 
without no or minimal modifications to physical hardware, essentially eliminating 

20 manufacturing revision costs in designing special purpose computers. Current 

configurable devices, however, are severely limited in capacity and cannot be used 
for complex applications. — 

A part can be simulated in hardware using PLDs, described above in the 
25 background section. These, however, can only be effectively programmed using 
hardware description languages, which have many shortcomings. Until now, there 
has been no way to convert a program of any significant complexity from a high level 
software language like C to a direct hardware implementation. 
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Summary of the Invention 

The present invention provides a configurable hardware system for 
implementing an algorithmic language program, including a programmable logic 
device (PLD), a hardware resource connectible to the PLD, a means for configuring 
5 the PLD, and a programmable connection to the PLD. The programmable 

connection is typically an I/O bus connectible to the PLD. The PLD may include an 
and/or matrix device or a gate array, that is, a programmable array logic (PAL) 
device and a gate array logic (GAL) device. The hardware resource may be a DSP, 
a memory device, or a CPU. The hardware system is designed to provide resources 
10 which can be configured to implement some or all of an algorithmic language 
program. These resources can be placed on a module, referred to herein as a 
distributed processing unit (DPU). 

One example of an algorithmic program is the classic "Hello, World!" C 
15 program. This program could easily be modified to output that famous message to an 
LED readout only when prompted by user input or perhaps to repeat that message at 
selected times without input or prompting. Another example of an algorithmic 
program is a digital filter which modifies an input data stream such as a sound or 
video signal. 

20 

A larger system can be built to make an extensible processing unit (EPU) from 
multiple DPUs plus support modules. A typical DPU includes a PLD, a hardware 
resource connected to the PLD, a means for configuring the PLD, and programmable 
connections to the PLD. The programmable connections are typically an I/O bus. In 
25 addition, a typical EPU will include one or more dedicated bus lines as a 

configuration bus, used to carry configuration information over the configuration bus. 



30 



Each module in an EPU can be connected to other modules by one or more of 
several buses. A neighbor bus (N-bus) connects a module to its nearest neighbor, 
typically to the side or top or bottom in a two dimensional wiring array. A module 
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bus (M-bus) connects a group of modules, typically two to eight modules, in a single 
bus. A host bus (H-bus) connects a module to a host CPU, if present. A local bus 
(L-bus) connects components within a single module. 

5 The invention also includes a method of translating source code in an 

algorithmic language into a configuration file for implementation on a processing 
device which supports execution in place. This is particularly useful for use with the 
modules described above, including PLDs connected to a hardware device such as a 
DSP, CPU or memory. The PLD can be connected to a device capable of processing 
10 digital instructions. The algorithmic language can be essentially any such language, 
but C is a preferred algorithmic language for use with this invention. 

The method includes four sequential phases of translation, a tokenizing phase, 
a logical mapping phase, a logic optimization phase, and a device specific mapping 

15 phase; One embodiment of the method includes translating source code instructions 
selected from the group consisting of a C operator such as a mathematical or logical 
operator, a C expression, a thread control instruction, an I/O control instruction, and 
a hardware implementation instruction. The translator includes a stream splitter 
which selects source code which can be implemented on an available processing 

20 device and source code which should be implemented on a host computer connected 
to the processing unit. The hardware implementation instructions can include pin 
assignments, handling configurable I/O buses, communication protocols between 
devices, clock generation, and host/module I/O. 

25 One object of this invention is to provide hardware resources to implement an 

algorithmic software program in hardware. 

Another object of this invention is to provide an improved module for 
mounting and interfacing programmable logic devices. 

30 
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Another object of this invention is to provide a stream splitter to analyze an 
algorithmic source program and implement as much of the program as possible on the 
available hardware resources. 

5 Yet another object of this invention is to provide hardware resources which 

can be reconfigured in whole or in part in a relatively short time to allow swapping 
of computer instructions. This allows a single set of hardware resources to 
implement many different computer programs or a large program on limited 
resources. 

10 

Brief Description of the Drawings 

Figure 1 illustrates one embodiment of a module of this invention, in DIP 
package format. 

Figure 2 illustrates a second embodiment of a module of this invention, in 
15 SIMM module format. 

Figure 3 illustrates a PLD connected to an N-bus, M-bus and L-bus. 

Figure 4 illustrates the logic symbol and main connections to a DPU. 

Figure 5 illustrates a module with multiple DRAMs connected to a PLD. 

Figure 6 illustrates a module with multiple DSP units connected to a PLD. 
20 Figure 7 illustrates a different module including DSP units connected to a 

PLD. 

Figure 8 illustrates a bridge module. 
Figure 9 illustrates a repeater module. 

Figure 10 illustrates an extensible processing unit and the interconnections 
25 between distributed processing units. 

Figure 1 1 illustrates one pinout configuration of a DPU. 
Figure 12 illustrates a logic symbol for an EPU. 

Figure 13 illustrates one embodiment of an EPU assembled on a PC board and 
connected to an ISA bus interface. 
30 Figure 14 illustrates another embodiment of an EPU assembled on a PC board 

and connected to an ISA bus interface. 
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Figure 15 illustrates an embodiment of an EPU with two bridgemods, each 
connected to a common SCSI interface plus an alternate DPU configuration. 

Figure 16 illustrates several different configurations of buses. 

Figure 17 illustrates the components and process of stream splitting. 
5 Figure 18 illustrates the location of many code elements after using the stream 

splitter. 

Figure 19 illustrates program flow of an algorithmic source code program 
before and after applying the stream splitter. 

Figure 20 illustrates the program code resident on the host before and after 
10 applying the stream splitter. 

Figure 21 illustrates major elements of the steam splitter libraries and 
applications. 

Figure 22 illustrates the location and program/time flow for a program running 
on several modules without stream splitting. 
15 Figure 23 illustrates the location and program/time flow for the same program 

split to run on three modules and the host. 

Figure 24 illustrates emulation of the "C programming language in PLDs. 

Figure 25 illustrates several representations of flow through operations 
implemented in DPUs. 

20 Figure 26 illustrates several representations of state operations implemented in 

DPUs. 

Figure 27 illustrates implementation in an DPU of execution .domains. 
Figure 28 illustrates implementation in an DPU of conditional statements. 
Figure 29 illustrates implementation in an DPU of a conditional (while) 
25 loop and a for loop. 

Figure 30 illustrates implementation in an DPU of a function call and function 
definition. 

Figure 31 illustrates a H C W program implemented in a PLD and shows the state 
of the system at several times. 
30 Figure 32 illustrates a module particularly useful in practicing the invention. 
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Figures 33 and 34 illustrate alternate views of a variation of the module of 
Figure 32. 

Figures 35 and 36 illustrate a particularly useful pin arrangement and pin 
assignment for connectors to be used on the modules in Figures 32-34. 

5 

Detailed Description of the Preferred Embodiments 

The present invention is designed to provide hardware resources to implement 
algorithmic language computer programs in a specially configured hardware 
environment. The invention has been developed around the Xilinx XC 3030 field 
10 programmable gate array (FPGA) but other Xilinx parts would work equally well, as 
would similar parts from other manufacturers. A PLD typically contains configurable 
logic elements plus input and output blocks and usually includes some simple connect 
paths, allowing implementation of a variety of state machines or a simple reroutable 
bus. 

15 

The simplest implementation of the device of this invention is a combination of 
a programmable logic device (PLD), a hardware resource, a means for configuring 
the PLD and a programmable connection to the PLD. Referring to Figure 1A, PLD 
11 is connected to a hardware resource, DRAM 13, through one or more address 

20 lines 18A, one or more control lines 18C, and one or more data lines 18D. One 
means for configuring PLD 11 is from configuration data stored in EPROM 12 
through EPROM interface lines 19A and 19B. Alternatively, configuration data can 
be loaded through one or more user I/O lines 17. EPROM 12 can contain data or 
other information useable by the PLD once it is configured. EPROM 12 can also 

25 contain data for multiple configurations. These devices can be assembled as a single 
module, e.g. distributed processing unit (DPU) 10. Referring to Figures IB, 1C and 
ID, one embodiment of DPU 10 consists of carrier 15 with traces (not shown) 
connecting one or more EPROMS, e.g. EPROMS 12A and 12B, to PLD 11 and 
other traces connecting one or more DRAMs, e.g. DRAMs 13A through 13D, to 

30 PLD 11. Additional traces connect user I/O lines 17 between PLD 11 and pins 16 on 
the edge of carrier 15. Pins 16 can be connected to external circuitry with I/O lines, 
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power, clock and other system signals, if needed. PLD 11, EPROM 12 and DRAM 
13 can be connected to carrier 15 by surface mounting, using a chip carrier, or using 
other techniques well known in the art. It is also possible to implement the entire 
DPU 10 on a single semiconductor substrate with programmable interconnect linking 
5 PLD, EPROM and DRAM blocks. 

A basic configuration routine can be stored in EPROM 12 so that when the 
device is first powered up, EPROM 12 will load an initial logic configuration into 
PLD 11. I/O pins on PLD 11 for lines 17 and 18 are allocated and protocols for 

10 using those lines are pre-defined and stored in EPROM 12 then loaded from EPROM 
12 into PLD 11 when DPU 10 is first powered up and configured. At least one line 
19 between EPROM 12 (if present) or user I/O line 17 (if no EPROM present) is 
permanently configured in order to load initial configuration data. Data flows within 
DPU 10 via I/O lines 18 and 19 and may be buffered in DRAM 13. Data exchange 

15 with external devices flows over lines 17. DRAM 13 can be used to store 

information from EPROM 12, to store intermediate results needed for operation of 
the program on PLD 11, to store information from user I/O lines 17, or to store 
other data required for operation of DPU 10. Operators and variables, as needed for 
program function, are loaded as part of the configuration data in PLD 11. The 

20 sequencing of program steps does not necessarily follow the traditional von Neumann 
structure, as described below, but results from operation of DPU 10 according to the 
configuration of PLD 11 and the state of the system, including relevant inputs and 
outputs. Configuration data is reloadable according to the source program and 
current task and application requirements. 

25. 

In a preferred embodiment, data for several configurations is precalculated and - 
stored so as to be conveniently loadable into PLD 11. For example, EPROM 12 may 
contain data for one or more configurations or partial configurations. DRAM 13 can 
be used to store configuration data. If, during execution of a program on PLD 11, a 
30 jump or other instruction requires loading of a different configuration, the data for the 
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new configuration or partial configuration can be rapidly loaded and execution can 
continue. 

A simple device configuration might be used as a special purpose information 
5 processor. One or more of user I/O lines 17 can be connected to a simple input 
device such as a keyboard or perhaps a sensor of some sort (not shown). One or 
more other user I/O lines 17 can be connected to a simple output device such as an 
indicator light or an LED numeric display (not shown). 

10 Alternatively, a DPU can be prepared in a preconfigured and consistent 

modular package with assigned pins for power, programming, program data, reset, 
system control signals such as clock, and buses for use with the system. In a 
preferred embodiment, a DPU is a module with 84 pins and 3 configurable buses, 
with 20 pins for each configurable bus and 34 pins for the remaining functions. 

15 Referring to Figures 2A through 2D, the DPU is built on a standard 84-pin SIMM 
board 20, 134 mm wide, 40 mm high, and 1 millimeter thick, with edge connectors 
21 for connection to socket 22 in connector 22A (Figure 2C). Locking pins 24 
engage holes 23 to hold board 20 firmly in socket 22. Referring to Figure 2C, board 
20 can be connected to a corresponding socket such as AMP822021-5. Board 20 can 

20 hold up to four devices 25 on one side. Each device 25, preferably 33 x 33 mm, 

may be a DSP, a PLD, EPROM or other device. In one preferred embodiment, each 
device 25 is a DSP such as an Analog Devices AD 2105, AD 2101 or AD 2115. In 
another preferred embodiment, each device 25 is a PLD such as a Xilinx XC-4003. 
Board 20 can hold PLD 11 and DRAM 27 on the other side. In a preferred 

25 embodiment, PLD 11 is a Xilinx XC-4003, 33 x 33 mm, coupled to eight 4 Megabit 
DRAM 27 memory chips. In another preferred embodiment, PLD 11 is a Xilinx 
3030. The devices can be surface mounted to minimize overall size. Referring to 
Figure 2D, board 20 is about 1-2 mm thick, and DRAM 27 is about 1 mm thick and 
PLD 11 is about 5 mm thick, giving an overall thickness of about 7-8 mm. The 

30 overall space envelope for a fully loaded board 20 is less than 135 by 40 by 8 mm. 
Sockets are designed on 0.4" (10.1 mm) pitch. 
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Referring to Figure 3, PLD 11 together with DRAM 13 and the connecting 
wiring are part of DPU 59. PLD 11 contains one or more configurable logic blocks 
30, e.g. 30A, 30B, one or more configurable I/O ports including neighbor bus (N- 
bus) control port 31, program control port 32, address generator 33, and DRAM 
5 control 35, and other portions such as X-bus I/O control 34, X-bus 37 connected to 
tristate buffers 36A, 36B, and power circuits 38, The X-bus is an arbitrary bus that 
provides a means to pass signals through PLD 11 without modifying them. PLD 11 
is connected to DRAM 13 through programmable interconnect which can be 
reconfigured as needed to complete the interface. The specific pins on PLD 11 that 

10 carry signals to DRAM 13 can be reconfigured as needed. Typically the wires that 
actually connect PLD 11 and DRAM 13 are fixed in place, but the function of each 
wire can be reconfigured as long as both PLD 11 and DRAM 13 have configurable 
inputs. PLD 11 has reconfigurable input and output pins. DRAM 13 can be 
manufactured with reconfigurable inputs and outputs, although at present there are no 

15 such devices on the market. PLD 11 still may be reconfigured to interact with a 
variety of DRAM devices which may have differing pin functions and pin 
assignments. Address generator 33 is connected through one or more (typically 10) 
address (ADDR) lines 53 to address circuits in DRAM 13. X-bus 37 is connected 
through tristate buffer 36B through one or more data lines 54 to data circuits in 

20 DRAM 13. DRAM control 35 is connected through one or more RAM control 

(RAM-C) lines 55 to RAS and CAS circuits in DRAM 13 and through one or more 
bus control (BUS-C) lines 56 to read and write circuits in DRAM 13. 

PLD 11 is connected through several configurable lines to the rest of the 
25 system, represented here by connect block 47. N-bus control port 31 is connected to 
one or more lines which form neighbor bus (N-bus) 49. X-bus 37 is connected 
through tristate buffer 36A to one or more lines which form module bus (M-bus) 50. 
Program control port 32 is connected through one or more lines 51 to program 
circuits in connect block 47. In some applications, the program control lines will be 
30 fixed and not reconfigurable and provide a means of loading initial configuration or 
program information into PLD 11. Power circuits are connected to power circuits 
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through one or more lines 52. In most applications, power lines 52 would not be 
reconfigurable and would be hard wired to serve a single function. 

N-bus 49 provides global connectivity to the closest neighboring DPU 
5 modules, as described below, allowing data to flow through a systolic array of 

processors. M-bus 50 provides connectivity within a group of DPUs, as described 
below, which typically extends beyond immediate neighbors. 

One or more lines form L-bus 58 which connects PLD 11 through I/O circuits 
10 (not shown) to other PLDs or other devices, generally mounted in the same DPU. 
The L-bus allows multiple PLDs in a single DPU to implement Boolean logic that 
will not fit on a single PLD. N-bus 49, M-bus 50 and L-bus 58 are configurable into 
an arbitrary number of channels, with arbitrary protocols. The total number of 
channels in any bus is limited by the total number of lines allocated to that bus but 
15 one skilled in the art will recognize many ways to allocate total lines among several 
buses. 

Referring to Figure 4, a DPU can be represented by a logic symbol with 
connections to power 52A, 52B, bidirectional buses M-bus 50, N-bus 49, H-bus 59, 
20 and generally unidirectional lines program 51A, program data 51C, reset 51B, and 
clock 51D. 

With these basic design considerations in mind, one skilled in the art will 
recognize that many combinations of useful components can be assembled using the 

25 teachings of this invention. Referring to Figure 5, a PGA-Mod distributed processing 
module 80 may consist of carrier 15 (Figure IB) or preferably board 20 (Figure 2A) 
fitted with PLD 11 as an interface device connected together with DSP 28 and one or 
more PLDs 25 through local bus 58. Each PLD 25 is connected to each adjacent 
PLD 25 through local-neighbor bus 61 and to local DRAM 27 by bus 62. PLD 11 is 

30 also connected to N-bus 49 and M-bus 50. Buses N-bus 49, M-bus 50 and L-bus 58 
may each be one or more lines, preferably 20. In one preferred embodiment, 

- 15 - 



WO 94/10627 PCT/US93/10623 

interface PLD 11 is an XC-3042-70, each of four PLDs 25 are an XC-4003-6, each 
of four DRAMs 27 may be 256 KB, 512 KB, 1 MB or, preferably, 4 MB, and DSP 
28 is an Analog Devices AD 2105, a 10 MIP part, or AD 2101 or AD 2115, 
operating at up to 25 MIPs. Faster parts or parts with more resources can be 
substituted as needed. 



Another useful embodiment includes multiple DSP chips to provide a scalable 
intelligent image module (Sllmod). Referring to Figure 6, Sllmod 80A is a DPU 
where PLD 11 is connected to N-bus 49 and M-bus 50, to DRAM 13 through one or 

10 more, preferably ten, address lines 53, one or more, preferably sixteen, data lines 54, 
one or more, preferably two, RAM-C lines 55 (connected to RAS, CAS circuits in 
DRAM 13), and one or more, preferably two, BUS-C bus control lines 56 (connected 
to read/write circuits in DRAM 13), plus one or more, preferably ten, lines forming 
serial bus (S-bus) 67. Each bus line of 53, 54, 55, and 67 is bidirectional in this 

15 implementation except DRAM 13 does not drive ADDR bus lines 53 or BUS-C lines 
56. A unidirectional bus is indicated in Figure 6 by an arrow head, a bidirectional 
bus has no arrows. PLD 11 is connected to one or more DSPs 25 through address 
lines 53, data lines 54, and BUS-C bus control lines 56, plus one or more, preferably 
four, bus request lines 64, one or more, preferably four, bus grant lines 65, one or 

20 more, preferably two, reset/interrupt request lines 66 and S-bus 67. DSPs 25 are 
allocated access to internal bus lines 53, 54, 56 using a token passing scheme, and 
give up bus access by passing a token to another DSP or simply by. not using the bus. 
In one preferred embodiment, PLD 11 is an XC-3042, DRAM 13 includes 4-8 MB of 
memory, and each DSP 25 is an Analog Devices AD 2105. S-bus 67 is configured - 

25 to access the serial ports of each device in Sllmod 80 A and is particularly useful for 

debugging. DSPs 25 can access DRAM 13 in page mode or in static column mode, x 
PLD 11 handles refresh for DRAM 13. The dimensions of each of bus lines 53, 54, 
56 are configurable and the protocols can be revised depending on the configuration 
and programming of each part and to meet the requirements of the dataflow, data 

30 type or types, and functions of any application program running on the module. 
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Another useful embodiment includes an array of eight DSPs to provide a 
DSPmod. Referring to Figure 7, DSPmod 80B is a DPU where PLD 11 is connected 
to N-bus 49 and M-bus 50, through buses equivalent to those in Sllmod 80A, 
including address lines 53, data lines 54, and BUS-C bus control lines 56, plus S-bus 
5 67, reset/interrupt request lines 66 and, preferably one line for each DSP 25, bus 
request lines 64 and bus grant lines 65, The DSPmod differs from a Sllmod 
principally in that the DSPmod does not include DRAM 13. PLD 11 can include 
memory resources to boot DSPs 25, such as an EPROM 12 (not shown) or 
configuration data loaded into PLD 11 from an external location (not shown). S-bus 

10 67 can be configured to transfer data to and from DSPs 25 at 1 megaByte per second 
per DSP. The S-bus is primarily included as another means to selectively access a 
specific DSP, particularly for debugging a new protocol or algorithm. In general 
operation, the S-bus can be used to monitor the status of or data in any connected 
DSP. In a preferred embodiment, the DSPmod includes eight Analog Devices 2105s. 

15 Other DSPs can readily be designed into the DSPmod. 

Certain special-purpose modules facilitate connecting DPUs into larger, 
integrated structures which can be extended to form very large processing arrays. 
Each DPU has an environment of incoming and outgoing signals and power. A 
bridge module (bridgemod) is provided to buffer data and to interface between H-bus 
signals and a local M-bus signals. This allows distribution of the host bus signals to 
a local M-bus and concentration of M-bus signals without undue propagation signal 
degradation or propagation time delay. A bridgemod is also provided to maintain the 
proper environment for each downstream DPU, including maintaining DPU 
configuration, power, and a synchronized clock. Referring to Figure 8, bridgemod 81 
connects PLD 11 to H-bus 59 and to M-bus 50, as well as to system lines 51 
including program-in, program data, reset and clock-in. PLD 11 is also connected 
through L-bus 58 to DRAM 13. PLD 11 controls a group of program-out lines 51E, 
each controlled by a latch 51L. Each program-out line 51E is connectible to a 
downstream DPU to signal the sending of configuration data for that DPU on M-Bus 
50. DSP 25 can be included but is optional. If present, DSP 25 can be used for 
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debugging and other functions. Clock buffer 69 cleans and relays clockin (CLKIN) 
68 to clockout (CLKOUT) 70. Power lines 52A, 52B are connected to the parts in 
bridgemod 81 (not shown) and distributed to downstream DPUs. In a preferred 
embodiment, H-bus 59 and M-bus 50 each contain one or more lines, preferably 20, 
5 and L-bus 58 contains one or more lines, preferably 40. DRAM 13 can store 

configuration and protocol information, for rapidly updating downstream DPUs. A 
typical DPU PLD will use no more than 2 KB of configuration data so 2 MB of 
DRAM 13 can store about 1,000 configurations for downstream PLDs. PLD 11 is 
preferably an XC 3042. DRAM 13 is preferably 2 MB but more or less memory can 
10 be used for a particular application or configuration. 

In a preferred embodiment, a bridgemod includes a PLD which can be 
configured as described above for DPUs. Within the bridgemod, each signal line of 
the H-bus and each signal line of the local M-bus is independently connectible to the 
15 PLD in that module, typically hardwired to an I/O pin of the PLD. This allows 

flexible and variable connection through the PLD between the H-bus and the local M- 
bus and at times may vary from connecting no common lines to connecting all lines 
between the buses. The PLD on the bridgemod can be configured using the same 
techniques described above for DPUs. 

20 

A repeater module (repmod) is provided to buffer and to drive bus lines over 
long distances. Such modules are used as needed to boost signals on the H-bus to 
modules which are distant from the host, allowing the bus to be arbitrarily long. 
Referring to Figure 9, PLD 11 connects inbound H-bus 59 (connected to the host) 

25 and buffered H-bus 59B (connected to one or more downstream bridgemods). In a 
preferred embodiment, H-bus 59 is configurable only in 8-bit groups, e.g. 8-, 16-, 
24- or 32-bit, to facilitate connection to existing buses. PLD 11 is also connected to 
bus buffers 71A-E and clock buffer 69, including enable, clock and direction control 
lines 72, preferably three lines, to designate whether the buffer is to act on inbound 

30 or outbound signals. These buffers preferably are synchronized to remove any skew 
in the clock or other signals on the H-bus. The buffers keep signals clean, full 
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strength, and synchronized. Bus buffers 71A-E include host data buffer 71A and host 
control buffer 71B, tri-state buffers which can be enabled to buffer signals in a 
selected unidirectional direction. Host reset buffer 71C, host program buffer 71D 
and host program data buffer 71E, when enabled, buffer signals from H-bus 59 to H- 
bus 59B to buffer signals carrying reset, program and data instructions to downstream 
modules, allowing the host (not shown) to reset, configure, and otherwise control 
downstream modules. This control would typically be directed to downstream 
bridgemods, and control of DPUs on each bridgemod typically would be handled by 
signals on the host bus control lines. Clock buffer 69 cleans and relays clockin 
(CLKIN) 68 to clockout (CLKOUT) 70. The connections between host I/O channel 
and the local extension of the H-bus typically are hardwired but may be 
programmably connectible. 

H-buses 59, 59B are connected in parallel to PLD 11 and bus buffers 71A-E. 
15 The bus buffers clean and repeat signals from one host bus to the other under the 
control of PLD 11, which monitors the state of each host bus and sets appropriate 
enable lines to control which buffers can repeat signals and in which direction to 
operate. For example, H-bus 59 may carry a packet for distribution to H-bus 59B. 
If the packet arrives while H-bus 59B is otherwise busy, possibly with a competing 
20' write request to H-bus 59, then PLD 11 can return a busy signal to H-bus 59. Small 
packets might be stored in PLD 11 without returning a busy signal. When H-bus 59 
is free to write, PLD 11 enables the bus buffers 71A-E. Conversely, when H-bus 
59B requests access to H-bus 59, PLD 11 will wait until H-bus 59 is free, then 
enable bus buffers 71A-B in that direction. 

25 

Data is best transferred in the form of writes, not reads, so that packets can be 
stored and forwarded as necessary without the need to establish and hold an open 
channel for reading. A typical read then would be performed by send a "write 
request" and waiting for a return write. 

30 
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Extensible Processing Unit (EPU) 

Referring to Figure 10, an array of DPUs 80 can be linked through neighbor 
buses (N-buses) 49, module buses (M-buses) 50, and a host bus (H-bus) 59 to form 
extensible processing unit (EPU) 90. In a preferred embodiment, an EPU is simply a 
5 regular, socketed array with limited wiring, each socket adapted to accommodate the 
DPU illustrated in Figure 2 A or related support modules. Modules in the EPU may 
include any of several types of DPU, including a PGA module (PGAmod), a SIIM 
module (Sllmod) or DSP module (DSPmod) or support modules including a bridge 
module (bridgemod) or repeater module (repmod). This regular array allows using a 
10 flexible number of DPUs in a specific configuration or application. 

The physical modules might be in a two dimensional array oi^in a geometric 
configuration which can be equated to a two dimensional array. The following 
discussion refers to "horizontal" and "vertical" relationships, referring specifically to 
15 the drawings, but one skilled in the art will understand this can be implemented in a 
number of ways. 

In a preferred embodiment, essentially every pair of horizontally or vertically 
adjacent modules is connected through an N-bus. Each DPU is connected to each of 

20 its nearest "horizontal" neighbors by an independent N-bus, e.g. N-bus 49B between 
DPU 80A and its neighbor DPU to the right 80B and N-bus 49C between DPUs 80C 
and 80D. N-bus 49D connects DPU 80D to the DPU to its right and N-bus 49F 
connects DPU 80F to the DPU to its left. An N-bus may also connect other adjacent 
modules. Still other N-buses connect vertically adjacent modules, if present. N-bus 

25 signals and protocols are controlled by the PLD on each DPU and can be varied as 
needed to provided communication between selected specific modules or selected 
types of modules. 

Bridgemods can be included in the N-bus connectivity or skipped. For 
30 example, N-bus 49E connects DPU 80D to its nearest DPU neighbor to the right, 
DPU 80E. This might be achieved by inserting a jumper, by hard wiring a mother 
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board to route that N-bus, or, preferably, by connecting N-bus 49E to bridgemod 
81B, which passes the bus directly through to the neighboring DPU. Alternatively, it 
is entirely feasible to include bridgemods in the N-bus network. In this case, N-bus 
49E1 connects DPU 80D to bridgemod 81B and N-bus 49E2 connects bridgemod 
5 81B to adjacent DPU 80E. In this embodiment, N-bus 49A connects bridgemod 81A 
to DPU 80A and N-bus 49H connects vertically adjacent bridgemods 81 A and 81C. 

In a preferred embodiment, an M-bus serves as a local bus to share signals 
among all of the modules, typically DPUs, on that M-bus. In each module, each 

10 signal line of the local M-bus is independently connectible to the PLD in that module, 
typically hardwired to an I/O pin of the PLD. In a large EPU, there may be multiple 
M-buses, connecting separate groups of DPUs. Each group includes a bridgemod to 
connect the local M-bus to the H-bus. A group of several DPUs, e.g. 80A through 
80D, are each connected together and to bridgemod 81A through M-bus 50A. 

15 Similarly, DPUs 80E through 80F are connected together and to bridgemod 81B 
through M-bus 50B, DPUs 80G through 80H are connected together and to 
bridgemod 81C through M-bus 50C, and DPUs 801 through 80J are connected 
together and to bridgemod 81D through M-bus 50D. 

20 Each bridgemod serves to connect the H-bus to the local M-bus, as described 

above. Bridgemod 81C connects M-bus SOC to H-bus 59B at 85E. Similarly, 
bridgemod 81 A connects M-bus 50 A to H-bus 59 A at 85B, bridgemod 81B connects 
M-bus 50B to H-bus 59A at 85C, and bridgemod 81D connects M-bus 50D to H-bus 
59B at 85F. 

25 

EPU 90 includes repmods 82A and 82B. As described above, a repmod 
connects the host I/O channel to a portion of the H-bus. Repmod 82A is connected 
to host I/O channel 84 at junction 84A and to host bus 59A at point 85A. Repmod 
82B is connected to host I/O channel 84 at junction 84B and to host bus 59B at point 
30 85D. 
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A two dimensional array of modules, as illustrated in Figure 10, is filled only 
to certain limits in each dimension, creating a top, a bottom, a left side and a right 
side. Various bus connections are designed to connect to adjacent modules but at the 
edges there are no modules present. These bus connections can be terminated or can 
5 be coupled together, for example as another bus. In Figure 10, EPU 90 has no N- 
bus connection from DPU 80F to any module on the right. The bus connections can 
be terminated with pull-up resistors, allowed to float, or simply not assigned to any 
connections by the PLD on DPU 80F. Similarly, there are no N-bus or M-bus 
connections to the right or left of EPU 90. N-bus connections 86A, 86B and others 

10 from the top of each DPU in the top row of modules are tied to top bus (T-bus) 85 
which may be connected to selected bus or signal lines (not shown). T-bus lines may 
be connected in parallel to several DPUs but preferably will provide a collection of 
independent lines to DPUs, allowing an external device to individually exchange data 
with a DPU. This may be particularly useful in a large imaging application where 

15 each DPU has access to a separate portion of a frame buffer or to a distributed 

database. T-bus 85 can provide a high bandwidth connection to the modules at the 
top of the array. Similarly, N-bus connections 88A, 88B from the bottom of each 
DPU in the bottom row of modules are tied to bottom bus (B-bus) 87 which may be 
connected to selected bus or signal lines (not shown), in a manner similar to that 

20 described for the T-bus. B-bus 87 can provide a high bandwidth connection to the 

modules at the bottom of the array. In certain embodiments, bridgemods may also be 
connected to the T-bus and B-bus as illustrated by N-bus connections* 86C and 88C. 

A wide variety of DPU modules can be designed, but in general a limited 
25 number of DPU types will provide extraordinary functionality and can be used for a 
very wide variety of applications. Using the EPU format, multiple EPUs can be 
mounted in a suitable frame and connected through the host bus and other buses 
described above. Multiple EPUs can be placed edge to edge and connected to form 
large processing arrays. The principal limitation on size is the time required to 
30 propagate signals over long distances, even with repeaters, and limits on signal 
carrying capacity when using long lines. Persons skilled in the art are well 
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acquainted with long signal lines and with methods to maximize signal transmission 
without loss of data. 

An EPU can be connected to DPU buses in a variety of ways. In a preferred 
5 embodiment, a DPU is a single card with an 84 pin edge connector as described 
above in relation to Figure 2. An EPU board can be fitted with a series of 
corresponding sockets such as AMP822021-5. Referring to Figure 11, connections 
91 A, 91B on the "top" row of sockets on board 20 are assigned odd numbers (as 
shown) and connections 92A, 92B on the "bottom" row of sockets on board 20 are 

10 assigned even numbers (not shown). Connections 91A-3 through 91B-53 are 

assigned to M-bus 50 lines 0 through 19, with some intervening ground and power 
connections, as shown. Similarly, connections 92A-2 through 92B-S2 are assigned to 
N-bus 49 lines 0 through 19, with some intervening ground and power connections. 
Connections 91B-55 through 92B-78 are assigned to H-bus 59. Connections 92B-80 

15 through 91B-83 are assigned to system functions reset (R), program (P), program 
data (D), and clock (C). 

A series of sockets on a board can be prewired for a selected configuration. 
For example, to construct the EPU of Figure 10, a series of sockets can be wired to 

20 connect N-bus lines n0-n4 to the left adjacent module, n5-n9 to the upper adjacent 
module or T-bus, as appropriate, nl0-nl4 to the right adjacent module and nl5-nl9 
to the lower adjacent module. All M-bus lines m0-ml9 could be wired in parallel for 
a group of sockets, and H-bus connections only to sockets for bridgemods 81 A, 81B, 
81C and 81D. Since repmods 82A and 82B have no N-bus or M-bus, leads for any 

25 of those lines are available to wire host I/O bus 84 to the corresponding sockets. 
Many potential configurations can be designed easily by one skilled in the art. 

An EPU can be indicated by the simple logic symbol illustrated in Figure 12, 
with connections to I/O bus 84, top bus (T-bus) 85 and bottom bus (B-bus) 87. 

30 
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An EPU can be laid out in a wide variety of configurations, such as a standard 
ISA bus board or a Nu-Bus board. One such configuration is the Transformer- 100X 
or TF-100X, shown in Figure 13B. This particular configuration implements three 
DPUs not as discrete modules on individual boards but as an EPU of fixed 
5 configuration with capacity for components to form three specific DPUs. The board 
is socketed for discrete devices which, if present, can provide a bridgemod, two 
Sllmods and one PGAmod. This configuration allows the user to provide devices for 
a DPU, if desired, and to select how much memory to include in any particular DPU. 

10 

Referring to the block diagram in Figure 13A, I/O bus 84 connects to ISA bus 
interface device 93 which handles all communication with the external system (not 
shown) to and from the EPU. The external system can be one of any number of MS- 
DOS personal computers. ISA bus interface device 93 is connected through H-bus 59 
15 to a bridgemod section including PLD 11A connected to DRAM 13A. PLD 11A can 
be an XC 3042 or an XC 3030. DRAM 13 A can be sized as desired, preferably 2 
MB. 

PLD 11 A connects H-bus 59 to M-bus 50. M-bus 50 is preferably 20 lines 
20 wide. Each line can transfer information at 2 MB/sec, resulting in a net transfer rate 
of 40 MB/sec within the TX-100X board. M-bus 50 is connected to several devices 
which provide the functionality of two Sllmods and one PGAmod. ^M-bus 50 also is ■ 
connected to a daughterboard connector 95 for one or more additional processing 
devices such as a frame buffer or coprocessor. ISA bus interface device 93 can be 
25 connected to expansion bus connector 94 for further connections to another device, 
such as another EPU located externally. 

The TF-100X includes two Sllmod units. Each Sllmod is socketed for a PLD - 
11B, 11C, connected to M-bus 50. PLD 11B or 11C can be an XC 3030 but 
30 preferably is an XC 3042. The socket for each PLD 11B or 11C is hard-wired 

through L-bus 58 A or 58C, respectively, to sockets for four DSPs 25A and 25C and 
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for DRAM 13B and 13C, respectively, to provide Address, Data, RAV, RAS/CAS, 
Bus request, bus grant, interrupt and reset functions, as described above in relation to 
Figure 6. Each DSP 25 A or 25C, if present, is preferably an Analog Devices AD 
2105, a 10 MIP part, and DRAM 13B and 13C preferably is 4 Mbyte, 70 ns or 
5 faster, but may be 1 MB through 8 MB or other desired size. Bridgemod PLD 11A 
is also connected to each one of DSPs 2SA and 2SC through one or more, preferably 
one, lines in serial bus 67, The fully configured TF-100X board includes eight DSPs 
for a total of 80 MIPs processing power, coupled to 8 Mbyte of DRAM pool 
memory. 

10 

Bridge PLD 11A is also connected through M-bus 50 to sockets for four PLDs 
25B connected to form a PGAmod. Each of PLDs 25B is connected through a bus 
62 to corresponding DRAM 27A, which may be 256K through 2 MB, preferably 1 
MB. Bus 62 preferably is 24 lines, 8 for data. Each of PLDs 25B is connected to 

15 each other through one or more, preferably ten, lines of L-bus 58B. Each of PLDs 
25B may also be connected to its nearest neighbors by an additional L-bus (not 
shown). Each PLD 25B is preferably a Xilinx XC 4003 connected to 1 MB 70 ns 
DRAM. The ten lines of L-bus 58B transmit information at 20 MB/sec between 
PLDs 25B and each of PLDs 25B can access its associated DRAM 27A at 20 MB/sec 

20 over 8 data lines. 

Another EPU configuration is the Transformer 800, the TF-800X, generally 
similar to the TF-100X but with SIIM sockets to accept eight modular DPUs, as 
described above in relation to Figure 2. This is equivalent to one quadrant of the 

25 EPU of Figure 10. The configuration shown includes eight Sllmods. Referring to 
Figure 14, I/O bus 84 connects to ISA bus interface device 93 connected through H- 
bus 59 to a built-in bridgemod with PLD 11A and DRAM 13A. PLD 11A connects 
H-bus 59 to M-bus 50, which is connected to a series of eight 84 pin sockets. There 
are no daughterboard or external bus connectors but PLDs 11B can each be tied to a 

30 T-bus or B-bus (no shown) to provide additional resources. Each socket, as 

described above in relation to Figure 2 and Figure 1 1 , has connections for various 
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bus lines. A typical Sllmod is described above in relation to Figure 13 A but the 
Sllmod to be used here will be built on board 20 of Figure 2. Each Sllmod can be 
assembled and installed selectively so that an operational TF-800X may have a single 
Sllmod with only 500K memory or 8 Sllmods, each with 1 MB memory up to each 
5 Sllmod with 4 MB of memory or even more with future generations of commercial 
DSP and memory devices. A single Sllmod with 1 MB of memory can deliver 40 
MIPS and eight Sllmods, each with 4 MB of memory, can deliver 320 MIPS. 

Yet another EPU configuration is the large intelligent operations node or 
10 LION. One implementation of the LION is illustrated in Figures 15A and 15B. This 
is equivalent to either the top half or bottom half of the EPU illustrated in Figure 10, 
but with a modified repeater module. Referring to Figure 15A, the^EPU interfaces to 
an external system (not shown) through SCSI interface 96, connected to I/O bus 84. 
SCSI interface 96 can be a dual SCSHI I/O controller for high speed communication 
15 over I/O bus 84. SCSI interface 96 is preferably implemented as a SCSImod, a 

module similar to the repmod and with the same form factor as other modules in this 
system. This architecture can be readily adapted by replacing the SCSImod with 
module with an interface for another protocol, including ISA, NuBus, VME, and 
others. Each group or block of DPUs 80 is linked through an M-bus 50 to 
20 bridgemod 81, which is linked through H-bus 59 to SCSI interface 96. Each DPU 80 
is linked to its nearest neighbor through N-bus 49 and all DPUs 80 are linked 
together through T-bus 85 and B-bus 87 as described above in detail in relation to 
Figure 10. Each DPU may be a Sllmod, DSPmod or PGAmod of this invention. 

25 The EPU is preferably configured as a motherboard with 20 slots and 20 

corresponding connectors. The connectors can be SUM module connectors, as 
described above. This configuration allows an overall form factor of 5.75" wide x 
7.75" deep and 1.65" high, (146 x 197 x 42 mm) the same as a conventional 5.25" 
(13.3 cm) half-height disk drive. The motherboard includes a male SCSI connector 

30 97, dual fans 98, and dual air plenums 99 to control the temperature in the LION. 
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An alternative implementation of an EPU is shown at approximately full scale 
in Figure 15C. Module board 100 is fitted on each of the right and left top sides 
with a connector 101A, preferably a 50 pin connector on 0.05" x 0.05" centers. One 
useful connector is SAMTEC TFM-1-25-02-D-LC. It is convenient to carry M-bus 
5 lines 50 on one connector and H-bus lines 59 on the other connector, with some N- 
bus lines 49 in each connector. Referring to Figure 15D, the bottom side of board 
100 is fitted with a corresponding, mating connector 101B which is also a 50 pin 
connector but which can mate with the connectors on top of a second such module. 
One useful connector is SAMTEC SFM-1-25-02-D-LC. Signals for H-bus, M-bus 

10 and N-bus between modules can be directed through these connectors. Thus many 
modules can be stacked top-to-bottom to form an array or EPU. In addition, board 
10 is fitted with a right angle, 20 pin female connector 102 on 0.10" x 0.10" centers 
for connection to a T-bus. One useful connector is SAMTEC SSM-1-10-L-DH-LC. 
A similar connector 103 is provided at the bottom of the board for connection with 

15 the B-bus. Either of connectors 102, 103 can be connected to a standard ribbon cable 
for connection to a remote device. In addition, by using a suitable connector, 
connector 102 on one module can be fitted to connector 103 on a second module. A 
three dimensional array of modules can thus be assembled and highly interconnected. 
The connections allow significant space between modules which is sufficient in many 

20 applications to allow heat dissipation by convection without need for a fan or other 
forced cooling. See Figures 15E and 15F. 

Adjacent modules may be connected in a variety of ways. A motherboard can 
be fitted with sockets for each module, such as the AMP822021-5 described above in 

25 relation to Figure 2C, and each socket can be hardwired to other sockets. 

Alternatively, a number of connection methods allow a compressible, locally 
conductive material to be squeezed between PC boards to establish conductive 
communication between local regions of the boards. One such device is described in 
USPN 4,201,435. The connectivity of each PC board can be important. A typical 

30 PC board has a series of pads on an edge, designed to be fit into a socket or 

connected through a compressible conductor. In many PC boards, a set of pre- 
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manufactured pads on one side of the board connect directly to corresponding pads on 
the opposite side of the board. This facilitates passing signals through a uniform bus 
but can be a problem for the configurable bus of this invention. A better design 
provides pads on each side of a PC board which can be individually connected, 
5 preferably to the PLD of a module. A PLD can then pass a selected signal straight 
through between back-to-back pads, e.g. left-3 to right-3, it can individually address 
each pad, effecting a break in the bus, and it can redirect a signal which comes in, 
say at pad left-3, to continue through a nearby pad, e.g. right-4. A sequential shift of 
signals can be used to rotate a control line as signals pass along a series of modules. 

10 For example, an eight-bit bus may be allocated with one line per module among eight 
modules. Therefore a signal which is on line 0 for the first module will be on line 7 
of the second module and line 6 of the third module. At the same 'time, the signal 
which was originally on line 1 for the first module is on line 0 for the second 
module, and the signal which began on line 2 of the first module is on line 0 of the 

15 third module, so each module need only rotate signals passing through this bus but 
monitor the condition only of a selected position, e.g. line 0. 

Another preferred implementation is illustrated in Figures 32 through 34. 
Figures 33 and 34 show the top and bottom, respectively, of a module at 

20 approximately full scale. This implementation is designed to the PCMCIA form 

factor, with outer dimensions of 2.4" x 3.65". Referring to Figure 32, corners 321 of 
the module are rounded with a typical radius of 0.200". Holes 3204iave a typical 
diameter of 0.125" with typical standoff clearance of 0.25". Connectors 322 and 323 
are approximately centered along the "top" and "bottom" edges. Corresponding 

25 connectors are mounted on the opposite side of the board to provide a stackable 
module. Referring again to Figures 33 and 34, connector 323 of one module is 
designed to mate with connector 325 of an adjacent module while connectors 322 and 
324 mate in a similar fashion. 

30 In a preferred implementation, connectors 322-325 are 100 pin connectors (2 x 

50), with 50 mil spacing, surface mountable. The socket connectors 322, 323 are 
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mounted facing "up" from the board and the plug connectors 324, 325 are mounted 
"down" (Figure 34). Preferably, the socket connectors are part no. SFM-150-L2-S-D 
and the plug connectors are part no. TFM-150-12-S-D (or equivalent), available from 
Samtec, Inc., New Albany, Indiana. The connectors are mounted as shown in Figures 
5 33-34, with pin 1 oriented as shown. 

The pinout shown in Figures 35 and 36 has proved to particularly 
advantageous for several reasons. Aside from power and ground, essentially all of 
the pins are programmable. This allows enormous flexibility not only in 

10 prograrnrning a particular module, but in using a variety of modules. Since the 

function of each pin can be changed through compiling an appropriate configuration, 
different modules can be designed using components from different manufacturers. In 
general, the components themselves do not have compatible pinouts and are almost 
never plug compatible but routing programmable lines through the connector of this 

15 invention allows a programmer to make minor variations in a configuration program 
and achieve true module interchangeability. 

The general signal groups are as follows: 

GND 16 pins per connector, ground 
20 +5 1 1 pins per connector, 5 volt power 

MIO 41 pins, Mbus programmable I/O lines 
VIO 64 pins, Vbus programmable I/O lines 
MCLK 7 pins, Mbus clock lines (or general programmable I/O) 
VCLK 8 pins, Vbus clock lines (or general programmable I/O) 
25 HSel 9 pins, Card address lines, rotate as they pass through stack, pin 

HSel_0 is also PData line used for programming PLDs on the 
module 

MSel 9 pins, reserved. Card address lines, rotate as they pass through 
the card stack 

30 PGM 4 pins. Used for programming PLDs on module. 

The specific pin assignments for each connector are shown in Figures 34 and 35. The 
positioning of the signals as shown provides superior electrical performance and high 
speed signal transmission, with a relatively large drive current per pin. As discussed 
35 elsewhere in this specification, the pins on connectors on opposite sides of the board, 
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e.g. 322 and 324 on one module, can be connected straight through or rerouted 
through programmable or other connections to independently control signals to each 
connector. 

5 In addition, signals can be remapped so that corresponding pins are not 

connected straight through but rather in some modified connectivity. In particular, 
the HSel and MSel lines are rotated by one line within the group of 9, e.g. pin_0 
connects to pin_l, ... and pin_9 connects to pin_0. Each module can then monitor 
only a select pin, e.g. pin_0 and decode any signal on that line as a signal directed to 
10 that mod. A module that wants to signal to a mod three positions "up M can drive a 

signal on its pin_7 and that signal will get rotated to pin_0 of the target module. This 
allows simple communication without ny need for complex decoding, packetizing and 
bus arbitration. 

15 Confizurable Buses 

The configurable bus of this invention is a powerful tool, providing flexible 
communication within an adaptive architecture device. Each line of a bus connecting 
at least two PLDs can be assigned a different function at different time points, 
changing infrequently or frequently, even several to several hundred times per 

20 second. This allows highly flexible communication between devices. Hardwired 

lines between a socket and a PLD be configured to accommodate different signals for 
the same pin position on different parts. In addition, future devices * will include 
programmable pin assignments for memory and other devices. 

25 In one configuration, a bus can be configured to consist mostly of data lines, 

to transfer large amounts of data. In another configuration, each of several devices 
may be assigned a unique bus line, providing asynchronous communication between 
devices to, for example, signal interrupts or bus requests. In general, it is preferable 
to include a clock line and a reset line between each device. This may be part of a 

30 configurable bus or, preferably, it may be a designated separate line to each device. 
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A bus protocol can be similarly modified according to the programming of 
each PLD device. These protocols may need to interface with existing bus protocols 
for communication with external devices or may be optimized for internal 
communication. An initial bus protocol and bus configuration are generally loaded 
5 along with an application and may be reloaded or modified under control of an 
application. 

A few representative bus architectures and protocols are discussed here but the 
possible varieties are almost limitless. Referring to Figure 16, each DPU 80 has one 
10 or more buses of many lines each. A typical DPU of this invention is connected to 
three such buses, an M-bus, an N-bus and an internal L-bus (see Figures 5-7 and 
related discussion). Each bus preferably has 20 lines, each connected to a pin on 
DPU 80. These lines for each bus can be allocated independently in a variety of 
configurations. 

15 

Figure 16A illustrates one implementation of a standard 16-bit bus. Sixteen 
(16) lines 104 are allocated as data lines. Additional lines are assigned as single- 
function lines for address signal AS 105, read signal RS 106, write signal WS 107 
and an OK or acknowledge signal 108. A PLD within DSP 80 configures these lines 

20 to connect within DSP 80 to corresponding functions address, read enable, and write 
enable, and acknowledge, respectively. The corresponding timing diagram of Figure 
16B shows that at to when AS 105 and RS 106 and OK 108 are each high, the 
remaining bus contents are ignored. After DPU 80 arbitrates for bus control, AS 105 
goes low at t! signalling that an address will follow on data lines 104. As high 

25 address (ahi) bits are clocked in at tj, AS 105 stays low, signalling that low address 
(alo) bits will follow. RS 106 goes low at signalling that a data block follows on 
data lines 104. One clock later, RS 106 goes high and OK 108 goes low, signalling 
that data lines 104 now carry one block or a specified number of sequential blocks of 
valid data. One or more clock ticks later (shown at tj but possibly many ticks later) 

30 OK 108 goes high to acknowledge successful reading and subsequent signals on data 
lines 104 are ignored. A data block can be chosen to be a specific or a variable size. 
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The read cycle may continue for several clocks but a single clock read is illustrated. 
At the completion of the read cycle(s), RS goes high. If the data was successfully 
read, DPU 80 sends an OK signal at time t^,. 

5 An alternative bus architecture is a dual 8-bit bus. Referring to Figure 16C, 8 

lines 104A are allocated to data for bus 0 and 8 lines 104B are allocated to data for 
bus 1. Single lines are provided for cycle 0 line 109A and OKq 108A for bus 0 and 
cyclej line 109B and OK, 108B for bus 1 . The data lines are cycled between 
address/control signals and data and the cycle line specifies the current state. This 

10 could be modified to have several packets of address information, control information 
or data carried on the data lines. The corresponding timing diagram of Figure 16D 
for bus 0 shows that after cycle 0 109A goes low at time to, data<, lines 104A carry 
address signal AS, write signal WS, read signal RS, and may carry other signals as 
well. After cycle 0 109A goes high at t,, datao lines 104A carry data signals, which is 

15 confirmed by OKq 108 A going low. This process is repeated in one clock unit at 
time t> and time t3 and so on. 

Yet another alternative bus configuration is a set of single line buses. 
Referring to Figure 16E, sixteen buses, each comprising a single signal line 104, can 

20 carry 16 signals to 16 sets of locations or other buses. Sync lines 110 are used to 
assure proper timing. Providing separate sync lines 110 allows signals to travel 
varying distances and to arrive at DPU 80 at slightly different tiniest The timing 
diagram in Figure 16F shows how a representative signal line, SIGN0 104 carries a 
packet of signal address bits beginning with high order bit a a through low order bit a Q - 

25 between time to and t^ (or longer, depending on the protocol) followed by a data 
packet starting with high order bit d a through low order bit d 0 beginning at time tj. 
This may be followed by more data packets or another address packet immediately or 
after some delay. Serial transmission of information is well understood in the art and 
one can readily design a protocol to work with the buses illustrated in this figure. 

30 - 
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A bus may be partially hardwired, thus not configurable. This is particularly 
applicable for connections to outside, non-configurable devices such as an ISA bus or 
SCSI bus or a modem or printer. Referring to Figure 16G, DPU 80 is connected to 
a first bus VAR^ 111A of three lines, to a second bus VAR^ 111B of eight lines, and 
5 to a third bus VAR 2 111C of five lines. As in the implementation shown in Figure 
16E, four SYNC lines 110 are provided to coordinate data transfer. A bus may be 
partially hard wired and partially configurable. Referring to Figure 16H, serial line 
67 and VARO 111 are hard wired to provide four lines and six lines of 
communication, respectively, while eight data lines 104, clock 109, and OK 108 are 
10 reconfigurable. 



Finally, a simple stand-alone device built around the PLD of the invention can 
make use of reconfigurable buses. Referring to Figure 161, program control portion 
32 of DPU 80 is connected through a fixed bus to EPROM 12, containing a boot-up 
15 configuration and data. An LED readout 112 and keyboard 113 (not shown) are each 
connected through a fixed bus to DPU 80. Analog to digital converter (ADC) 114 is 
connected to DPU 80 through 9-line, configurable bus 116 and sync 110A and digital 
to analog converter (ADC) 115 is connected to DPU 80 through single-line, 
configurable bus 117 and sync HOB. 

20 

Another protocol, not illustrated, allows for absolute time to be known by 
essentially all devices in a system. The individual clock counters are reset, for 
example when the system is powered up, and some or all commands are expected to 
occur at a specified time. Devices then simply read or write a bus at the designated 
25 time. This obviously has the potential for great complexity but also may offer 

significant speed benefits, eliminating the need for bus arbitration, address packets, 
control packets and so forth. 

The bus protocol can be allocated according to need under the control of a 
30 compiled host program, possibly with modification by specific application C code 
instructions. In general, all buses share a Clock-Line and a Reset-Line. Bus 
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configuration and protocol data is preferably downloaded when the application is first 
loaded and may be reloaded under control of the application. Reconfiguration data 
can be loaded in less than about 10 milliseconds. In order to address each DPU 
directly, each DPU can be assigned an address based on a physical slot or 
5 relationship within the system. DPUs can be provided with registers and. internal 
memory holding an offset address. DPUs may store and forward packets of data as 
needed. 

The configurable bus offers significant benefits in terms of flexibility but it 
10 comes at a cost. The configurability allows implementation of large combinatorial 
logic functions, useful for rapidly solving complex branch or case tests, such as can 
currently be done only by designing a specific circuit, typically as an .ASIC. 
Execution of complex logic can be performed considerably faster than on a general 
purpose computer, but not as fast as on a true ASIC. However, the configurability 
15 means that the new device can function as one ASIC for a period of time, then be 

quickly reconfigured to function as a different ASIC. New generations of PLDs will 
have faster circuits and will reduce this speed difference considerably, although it is 
unlikely that a fully reconfigurable circuit will be 100% as fast as a custom designed 
circuit fixed in silicon. 

20 

Using the modules 

The modules and EPU described above can be configured to run one or more 
programs. A complex program may require many such signals, and can consume a 
large portion of valuable, available circuit area and resources. A reconfigurable 
25 device could allocate resources for signals only as needed or when there is a high 
probability that the signal will be needed, dramatically reducing the resources that 
must be committed to a device. 



Certain operations run better in specific hardware. For a conventional CPU 
30 with cache memory, registers and ALUs, these operations include data manipulation 
such as arithmetic functions and compares, branch and jump instructions, loops, and 
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other data intensive functions. Other operations are more easily handled in special 
hardware, such as ADC, DAC, DSP, video frame buffers, image scanning and 
printing devices, device interfaces such as automobile engine sensors and controllers, 
and other special purpose devices. 

5 

Stream Splitter - Compiling Algorit hmic Source Code . 

Conventional programming for a general purpose computer begins with a 
program written in any one of several suitable computer languages, which is then 
compiled for operation on a certain machine or class of machines. Programming in 
10 assembly language gives the programmer detailed control over how a machine 

functions but such programming can be very tedious. Most programmers prefer to 
write in a relatively high level language. 

The present device provides a greatly enhanced library of functions available 
15 to a computer program. Essentially, a conventional source code program can be 

converted in whole or in part into a series of specialized circuit configurations which 
will use the same inputs or input information to produce the same result as the 
conventional program running on a conventional computer but the result can be 
provided much faster in many cases. A wide variety of functions can be implemented 
20 * in hardware but can be accessed by a subroutine call from a main program. 

Where a conventional programmer might code to initialize two variables, then 
add them, a general purpose CPU must allocate memory space for the variables, at 
least in a register, then load an adder with the numbers and add the values, then send 
25 the result to memory or perhaps to an output device. Using a DPU, a PLD can be 
configured to add whatever is on two inputs, then direct the result to an output. For 
this simple operation, a DPU may not provide a significant improvement in ease of 
calculation in comparison to a conventional computer. 

30 The benefit of a DPU can be considerably greater when the desired operation 

is more complex. For example, pixel information may be provided in one or more 
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bit plane formats and may need to be converted to another format. For example, the 
input may be a raster image in a single plane, 8 bits deep. For certain applications, 
this may need to be converted to 8 raster image planes, each 1 bit deep. The first bit 
of each pixel word needs to be mapped to a first single-bit plane pixel map, the 
5 second bit to the second single-bit plane pixel map, and so on, to give eight single-bit 
plane pixel maps which correspond to the original 8-bit plane. It is relatively simple 
to configure hardware to split and redirect a bitstream according to a certain rule 
structure. This same method can be modified to combine eight single-bit planes into 
a single 8-bit plane, to create four two-bit planes, to create two four-bit planes, to 
10 mask one bit plane against a second bit plane, and so on. 

A particular application may frequently call one of several specific conversions 
(expected to be called frequently by the program or the user) and call other specific 
conversions less frequently. A compiler can calculate logic configurations to execute 
each of the common conversions and load the configurations simultaneously so that 
any is available simply by selecting the appropriate inputs. If there is limited PLD 
space available, configurations can be calculated and stored, ready to be loaded on an 
as-needed basis. If there is sufficient PLD space available, even the less-frequently 
called conversions can be resident in a PLD for immediate access when the need 
arises. By configuring a DPU with equivalent information, each of most or all likely 
inputs can be processed within a few clock cycles by providing a configuration for 
each likely input value and then simply activating the appropriate portion of the 
circuit. 

25 The implementation begins by analyzing an algorithmic language program and 

converting as much of that program as possible to run on available hardware 
resources. Many hardware languages are available and known, to varying degrees, 
by persons skilled in the art. These languages include ABCL/1, ACL, Act I, Actor, 
ADA, ALGOL, Amber, Andorra-I, APL, AWK, BASIC, BCPL, BLISS, C, C + + , 

30 C*, COBOL, ConcurrentSmallTalk, EULER, Extended FP, FORTH, FORTRAN, 
GHC, Id, IF1, JADE, LEX, Linda, LISP, LSN, Miranda, MODULA-2, OCCAM, 
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Omega, Orient84/K, PARLOG, PASCAL, pC, PL/C, PL/I, POOL-T, Postscript, 
PROLOG, RATFOR, RPG, SAIL, Scheme, SETL, SMPL, SIMULA, SISAL, 
Smalltalk, Smalltalk-80, SNOBOL, SQL, TEX, WATFIV and YACC. 

5 In a preferred embodiment, the C language is used for source. This provides 

several advantages. First, many programmers use C now and are familiar with the 
language. Second, there are already a large number of programs already available 
which are written in C. The C language allows simple implementation of high level 
functions such as structures yet also allows detailed manipulation of bits or strings, 

10 down to machine code level. The C language, especially with some simple 

extensions, is also well suited to object-oriented programming, which also works well 
with the present invention. Third, the C language is now so widely used that many 
translators are available to translate one language to C. Such translators are available 
for FORTRAN and COBOL, both popular languages, and translators exist for other 

15 languages as well. For convenience, the C program will be used as an example, but 
one skilled in the art will recognize how to apply the teachings of this invention to 
use other algorithmic languages. 

The method includes four sequential phases of translation, a tokenizing phase, 
20 a logical mapping phase, a logic optimization phase, and a device specific mapping 
phase. Current compilers tokenize source code instructions and map the tokenized 
instructions to an assembly language file. For instructions written in hardware 
description languages, there are logic optimization routines, but there are no current 
methods to convert algorithmic source code into a hardware equivalent. Source code 
25 instructions suitable for implementation in a PLD include a C operator such as 

mathematical operators (+, -, *, /), logical operators (&, &&, 1 1), and others, a C 
expression, a thread control instruction, an I/O control instruction, and a hardware 
implementation instruction. 

30 A programmer begins by preparing a program for a problem of interest. The 

program is typically prepared from C language instructions. The basic program 
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functionality can be analyzed and debugged by traditional methods, for example using 
a Microsoft C compiler to run the program on an MS-DOS based platform. This 
same C code, possibly with some minor modifications, can be recompiled to run on a 
configurable architecture system. 

The stream splitter separates C instructions in program source code in order to 
best implement each instruction, allocating each instruction to specific, available 
hardware resources, e.g. in a DPU, or perhaps allocating some instructions to run on 
a host or general purpose computer. Referring to Figure 17, stream splitter 202 
splits C program source code 201 into portions: host C source code 203 that is best 
suited to run on a host CPU; PLD C source code 204 that is best suited to run on a 
PLD of this invention; and DSP C source code 205 that is best suited to run on a 
DSP. Compilation requires library routines are available to provide needed 
resources, especially pre-calculated implementations for certain C instructions and 
partitioners and schedulers to manage intermodule control flow. Partitioner and 
scheduling resources 203B are added, as needed, from partitioner and scheduler 
LIBrary 202A to host C source code 203A to coordinate calls to other portions 204, 
205 of the C code which will be implemented in hardware. Communications 
resources 203C, 204B and 205B are added to C source code portions 203, 204, and 
205, respectively, from communications LIBrary 202B, as needed, to provide needed 
library resources to allow the system resources to interact once compiled and 
implemented in the system. Host C compiler 206A combines and compiles host C 
source code 203A, partitioner and scheduler resources 203B and communications 
resources 203C into executable binary file 207 and corresponding portions 207A, 
207B and 207C. PLD C compiler 206B combines and compiles PLD C source code 
204A and communications resources 204B into executable binary PLD configuration 
file 208 and corresponding portions 208 A and 208B, respectively and DSP C 
compiler 206C combines and compiles DSP C source code 205A and communications 
resources 205B into executable DSP code 209 and corresponding portions 209A and 
209B, respectively. 
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PLD code must ultimately operate on PLDs within the system and preferably 
includes configuration data for each PLD and for each configuration required to 
operate the system. PLD C source code must be translated or compiled to 
configuration data 208 useable on a PLD. One or more configurations must be 
5 prepared for essentially each PLD needed to operate a selected program, although not 
all programs will require all of the PLDs available in a given system. In general, 
configuration data must be provided for repmod, bridgemod and DPU PLDs, 
including PGAmod PLDs. For Xilinx parts, the C source code must be translated to 
a .BIT file, possibly through an intermediate compilation to .XNF format. DSP code 

10 must ultimately operate on DSPs within the system and preferably includes 

configuration data for each DSP and for each configuration required to operate the 
system. DSP C source code must be translated or compiled to executable machine 
code 209 for a DSP. Manufacturers of DSPs typically provide a language and 
compiler useful in generating DSP machine code. DSP C source code 205A may be 

15 translated into an intermediate form before compilation into final machine code 209. 

The result of stream splitting is illustrated in Figure 19. An original C source 
code program 201 may contain a series of three sequential function calls, function 0 
240 followed by function 1 241 and function 2 242. When executed on a general 

20 purpose computer, each function is executed one at a time in order. Each function 

may be quite simple, such as add two numbers, or may be quite complicated, such as 
convert a single 8-bit plane raster image to four two-bit plane raster images and mask 
(XOR) the first two-bit plane image against the sum of the second and fourth two-bit 
plane images. If function 1 241 can be implemented more efficiently on hardware, 

25 the stream splitter can analyze, convert and compile that function to run as function 
241A on a hardware resource such as a DPU and simply insert a MOVE DATA 
command 243 into the execution stream of the host program, coupled with an 
EXECUTE DATA command 244 on the DPU. If function 1 does not return any 
value and function 2 does not depend on the result of function 1 , or if function 2 does 

30 not need the result of function 1 and function 2 will take longer to execute than will 
function 1, then program control can pass immediately to function 2 242. 
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Alternatively, if function 1 does return a value needed by function 2 then function 2 
can wait for execution to complete. During execution, parameters needed by function 
1 are passed to the DPU(s) holding function 1 via DPU bus connections. Functions, 
whether on the host or on a DPU, may call one or more other functions, each of 
5 which may be on the host or the same or another DPU. 

The stream splitter is especially useful for automating data flow for: 
parameters passed and returned; global variables; and global arrays. Useful libraries 
in partitioner and scheduler LIBrary 202A and communications LIBrary 202B 
10 include: scheduling heuristics, libraries and templates; data conversion utilities; 
DMA; and FIFOs. 

A particular function is preferably implemented within a single PLD but larger 
algorithms can be partitioned between multiple PLDs and even between multiple 
15 DPUs. An arbitrarily large algorithm can be implemented by providing enough DPU 
modules. 

Referring to Figure 20, the conversion of original source code to partitioned 
functions can be better understood. Standard C source code 251 can be modified by 

20 a programmer to include compiler instructions to partition certain functions into select 
hardware resources. Modified source code 252 includes "DSP" and "END-DSP" 
commands around "funl {..}" to instruct the compiler to implement this function as a 
DSP operation. A precompiler partitions code 252A into host code 252B (equivalent 
to 203A in Figure 17) with a "MOV-DATA; ("funl", DSP)" call inserted in place of 

25 the original function code. That function code is partitioned into DSP code 253 

(equivalent to 205 A in Figure 17). The source code is supplemented by host source 
library routines 254 and DSP library routines 255. Additional code (not shown) is 
required to establish communication between the host and the DSP. 

30 The method of compiling is illustrated in Figure 21. Referring to Figure 21, 

given a specific configuration of DPU hardware 261, compiler 260 applies an input 
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filter, then collects data on the environment, including the DPU hardware 
configuration and available resources, capacities and connectivity. The scheduler- 
partitioner contains information on function and data dependencies, communication 
analysis, plus node allocation, partition, schedule and debug strategies and schedule 
5 maker constraints. The code generator and library provide additional resources for 
the maker to convert C source code using a third party C compiler plus an enhanced 
C syntax analyzer and C to PLD compiler to first tokenize the input source code, 
then prepare a logic map including variable allocation, C operators, expressions, 
thread control, data motion (between components and functions) and hardware 
10 support. The logic map is then evaluated for possible logic reduction and finally 
mapped to the available devices, as needed. 

The present system allows a linear program to be pipelined in some cases. 
Figure 22 illustrates a traditional single CPU, general purpose computer with a main 

15 program 270 which calls function 1 271, waits for execution, then calls function 2 
272, which in turn calls function 3 273, which completes execution, function 2 
completes and passes control back to main program 270. By way of comparison, 
Figure 23 illustrates the same program implemented in a distributed system. 
Assuming function 1 is amenable to partitioning (e.g. remapping a bit plane - half of 

20 the plane can be assigned to each of two processors), the program can work that 

much faster. Main program 270A on the host system again calls function 1 271A but 
271 A calls servers 270B and 270C, each of which call corresponding function 1 
portions 271B and 271C. When execution is complete, the servers notify host 
function 1 271 A, which notifies main program 270 A and 270 A calls function 2 272 A. 

25 Depending on the interrelation of function 1 and function 2, function 2 may be 

callable before function 1 is completed. Function 2 272 A calls server 270 A which 
calls function 2 272B, which in turn calls function 3 273B. When 273B and 272B 
have both completed, control is passed back all the way to host main program 270A. 

30 The process of converting C source code to a device configuration is illustrated 

in Figure 24. Briefly, source code 281 is tokenized, converting variable names into 
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generic variables, and analyzed for time dependencies where one operation must 
follow another but still another operation can occur simultaneously with the first. 
The tokenized code 282 can be assigned in execution domains segregated by 
sequential clock ticks. The logical components of tokenized code 282 are reduced to 
5 Boolean equivalents and enables are created in intermediate code 283. These Boolean 
equivalents are then mapped to PLD and DSP resources 284 for specific devices in 
the system. The logic map is converted to a device configuration format 285 
appropriate to the device being mapped, then the PLDs necessary for communication 
and other support functions are configured and all intermediate logic descriptions such 
10 as .XNF files are converted into binary, executable files, e.g. .BIT files for Xilinx 
parts. Some mapping strategies are listed in Figure 24. 

Several different descriptions and implementations of simple Boolean flow 

through operations are illustrated in Figure 25. The name of each of four functions, 
15 e.g. Inverter, are accompanied by a text description of the function, a logic 

equivalent, C source code, and the CLB equation which will implement the function. 

For example, an Inverter yields "For each bit of A if A N is 1, then B N =0, else 1." 

The C source code equivalent is "b = - a" and the CLB function (for .XNF coding) 

is a N = b(l,a N ). These operations do not depend on the clock state and large 
20 numbers of the operations can be evaluated asynchronously or even simultaneously. 

One limit is when a function is self referencing (e.g. "a = a+T) there should be an 

intervening clock tick. 

State operations can also be implemented easily. Referring to Figure 26, a 
25 latch, counter and shift register are described, diagrammed and shown in equivalent C 
code, CPU opcode and CLB equations. These concepts can be combined to evaluate 
logic. Referring to Figure 27 A, many logical instructions be implemented in a single 
step, when possible. Referring to Figure 27B, logic reduction can simplify the logic 
that must be mapped and can also take out unnecessary time dependencies. However, 
30 if a variable must take on different values at different times, each logical device can 
drive a single multiplexer so that variable can always be found at the output of the 
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MUX. Figures 28, 29 and 30 illustrate additional examples of logic that can be 
implemented, reduced and operated using the teachings of the present invention. 

System Improvements 

5 Program execution in a traditional C program on a general purpose computer 

involves incrementing a program instruction counter for each subsequent operation. 
Each C instruction is converted to a step of an variable but determinate number of 
machine instructions. There is only one counter in a typical machine, so only one 
operation can be conducted at a time. The result is that a very powerful machine 
10 must wait for each incremental step to be completed but each operation uses only a 
small portion of the resources available in the machine. 

After C instructions are converted to hardware functions, many functions can 
operate without waiting for a previous operation to complete. Since many hardware 

15 functions can operate simultaneously, it is desirable to operate the maximum number 
of functions possible at any time. Each function or C operation can be considered as 
a chain of events or commands. After conversion, each chain is initiated by passing 
a token to the first step in the chain. As each step in the chain is executed, the token 
is passed to the next step in the chain until the chain terminates. Where other 

20 functions depend on the result of the chain, a lock or hold command can be issued 
but for many functions there is no need to interact with any other functions. For 
example, a buffer driver as for a printer buffer, might be filled using a chain of 
commands comparable to the C "printf ' command. A token is passed for printing 
each character, along with the character or a pointer to it. Once the chain of printing 

25 is initiated, the hardware can continue with other operations and does not need to wait 
for the printing chain to complete. The next call to the print buffer may come as 
soon as the next system clock tick and, if the printing chain is not busy, a subsequent 
print chain can be initiated for the next character. 

30 The main program consists of a chain, with a token passing through it, which 

is connected to other chains and may spawn other processes for function calls and 
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other operations. This proliferation of tokens results in a superpipelined operation 
without true parallelization. The system can be used very successfully for parallel 
processing as well but normal C code can be accelerated without additional compiler 
development due to the creation and execution of multiple chains. 

5 

Another significant benefit of the present system is the availability of large 
combinatorial. Special circuits, such as ASICs, often combine many decision inputs 
into complex combinatorial circuits so the output may be affected by a large number 
of inputs yet evaluated essentially continuously. By comparison, if a general purpose 

10 program output depends on a number of inputs, typically only one or two inputs can 
be tested on any instruction cycle so each test of a complex combinatorial equation 
can take many instruction steps. The present system converts the general purpose 
program combinatorial into a hardware circuit, providing an essentially continuous 
correct output. The actual speed of operation of the present system is limited by 

15 hardware constraints so that it is slower than a custom ASIC by a factor of more than 
2 but this is considerably faster than essentially any general purpose computer. 

Yet another significant benefit of the present system is the availability of post 
functions. When a post function is called, the result of the previous output of the 

20 function is available immediately, without waiting for the function to execute again. 
This is useful in many loops, for example where there is an up or down counter. 
This is also useful when an intermediate result will be used as the input for a function 
which normally would not be called right away. By providing an input to a post 
function before the output is required, if the function can complete its operation 

25 before the result is needed, then a post function call at a later time can pick up that 
output without waiting. This functionality is provided already in general puipose 
computers in the form of post increment and post decrement counters such as "i+4- M 
or n— . 
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Tendin g and Runn ing Executable Code 

Once the program source code has been split and compiled, it can be moved 
onto the modules. Referring to Figure 18, host computer 220 can access data storage 
system 221 over bus 219 and can access EPU 90 over I/O bus 84. Data storage 
5 system 221 holds compiled, executable binary host code 207, PLD code 208 and DSP 
code 209, including corresponding LIBrary files, plus raw data 225A and processed 
data 226A for the program. Data storage system 221 may be cache memory, system 
DRAM or SRAM, hard disk or other storage media. 

10 Host 220 is connected through I/O bus 84 to bus interface 93 then through H- 

bus 59 to one or more bridgemods 81 A and 81B. Bus interface 93 might be a 
SCSImod such as 96 in Figure 15. Each bridgemod is connected to one or more 
DPUmods, bridgemod 81E is connected through M-bus 50A to DPUmods 80A, 80B 
and 80C and bridgemod 81B is connected through M-bus 50B to DPUmods 80D and 

15 80E. As described above in relation to Figure 10, a top array of DPUmods is 

connected to top bus 85 and a bottom array of DPUmods is connected to bottom bus 
87. A DPUmod includes memory some of which can be allocated to hold raw data 
225B, 225C and finished data 226A, 226B. 

20 When the program is called, host code 207 is loaded from data storage system 

221 is loaded into main memory 223 in host system 220. Host code 207 controls and 
directs loading of configuration DPU and DSP configuration code 208 and 209 to the 
appropriate destinations: PLD code 208 to PLDs in bus interface 93, if any, and 
PLDs in bridgemods 81A, 81B and DPUs 80A-80E including any needed PLDs in 

25 any PGAmods in the system; and DSP code 209 to any needed DSPs in the system. 

Configuration code is typically loaded in order of the devices accessible by 
host 220, first establishing configuration in the bus interface 93 sufficient to operate 
the interface, then configuring downstream devices starting with each bridgemod 
30 81A, 81B at least sufficient to load any additional configuration information, the 
configuring devices further downstream including DPUs 80A-80E, as needed. 
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Additional configuration information may be loaded as needed at a subsequent time, 
such as during operation of the system. 

Configuration data for Bus and RAm control logic blocks is installed in each 
5 PLD, as needed, to support RAM and the busses - H-bus, N-bus, M-bus and serial 
bus. This configuration data is preferably sent as a preamble to other configuration 
data so the receiving PLD can be easily configured. The configured device can then 
operate as a block, stream, or memory mapped processor. Debugging is 
accomplished by uploading configuration data to the host. The stat of each PLD is 
10 embedded in the configuration data and this can be examined using traditional 
methods. 

There are many possible schemes well known to one skilled in the art for 
loading configuration data through the buses as shown. For example, a single line 

15 might be hardwired to every configurable device on any connected bus. A signal 
could be sent over this line which would be interpreted as a command to wait for a 
set amount of time, then to allocate certain pins to bus functions which would then be 
used to read incoming configuration data. As only one example, the reset line is set 
high for two clocks the low to force a system reset, then followed one clock later 

20 with a one-clock high "initiate configuration" signal. Bus interface 93 interprets this 
as a command to set 16 of the pins connected to I/O bus 84 and connect those pins to 
receive configuration commands for a PLD in bus interface 93. Each- of bridgemods 
81 A, 81B interprets the reset/configure command and sets 16 of the pins connected to 
H-bus 59 and connects those pins to receive configuration commands for a PLD in 

25 the bridgemod. Each DPUmod, e.g. DPUmod 80A, interprets the reset/configure 

command and sets 16 of the pins connected to the M-bus, e.g. 50, and connects those 
pins to receive configuration commands for a PLD in the DPUmod. 

The host begins the configuration process by selecting a first bus interface, for 
30 example through a device address known to the host and specific to the first bus 

interface. A first configuration signal might be an "attention" signal to all connected 
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devices with a request for an acknowledge with identifier. Using well known bus 
arbitration, the host detects a signal from each connected device, then transmits a 
command, possibly coupled with a device address, for a selected bus interface, e.g. 
93, to adopt a desired configuration. The host can also transmit configuration for all 
bus interfaces simultaneously to adopt a desired configuration. One configuration 
connects the I/O bus and the H-bus, e.g. "connect each of pins 1-16 of the I/O bus to 
corresponding one of pins 1-16 of the H-bus." The host then sends an attention 
signal to all devices connected to bus interface 93 and monitors the response and 
identity of each such device. Each such connected device, e.g. bridgemods 81A and 
81B is configured to configure connections with any attached M-bus and the process 
is repeated down the line until each DPUmod or other attached module is configured. 
Another mode of default configuration is to have all devices on any bus adopt a 
default configuration providing essentially maximum bandwidth for incoming 
configuration data plus providing connections to "downstream" buses and parts, then 
begin a paging or arbitration scheme by which the host can identify and configure 
each connected configurable part. 

An EPROM can be included on each module to store one or more default 
configurations. A locally stored configuration can be loaded on command, e.g. by a 
20 sequence of signals on the reset line or on one or more separate configuration lines. 

Once a configuration is established allowing communication between the host 
and any selected part, the host can easily copy specific DPU configuration code to a 
specific DPUmod. In a preferred embodiment, the stream splitter is aware of the 

25 resources available on a specific computer and allocates DPU and other code to 
maximize utilization of the available resources. If the resources exceed the 
requirements of the program in C source code 201, then the entire program can be 
loaded onto the available resources at one time. If there are insufficient resources to 
load the entire program at once, then the host stores the necessary configuration data 

30 and ioads into the available resources when needed. This is analogous to swapping 
instructions of a larger program into RAM of a general purpose computer from a 
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connected storage device, typically a hard disk. The instructions that are needed at 
any moment are called up. Numerous sophisticated caching schemes are known in 
the art for designing code for this swapping and for anticipating what section of 
instructions will be needed next. These concepts and methods are useful in practicing 
5 the present invention as well. 

The following example of operation of the system of this invention illustrates 
control flow and other features of the invention. 

10 Example 

Referring to Figure 31, a PLD is configured to implement a source code 
program. This implementation illustrates specific resources available in many Xilinx 
parts such as the XC 3030. The source code shown when tokenized, logic mapped, 
logic-reduced, and device mapped gives the illustrated block logic diagram. The 

15 logic table shows the state of each line at times ^ - 1 4 and ^ - 1^. 

The program is initiated by passing an execution token to the main program, 
setting start 300 to 1 for one clock. START 300 drives the input of MAIN0 high and 
one clock later the MAINO output 301 goes high, passing the execution token to 
MAIN1 . This also sets one input of latch BUSY to one, simultaneously clocking 

20 NOR gate BUSY_CE so the output is true, which enables BUSY, latching the BUSY 
output 307 as 1 after the next tick. The execution token at MAIN1 sets MAIN1 
output 302 high at t^ passing the execution token to MAIN1H and enabling both 
CALL_FUN0 309 and CALLJFUN1 310, Depending on the state of pinO, a new 
execution token is propagated and passed to either FUN0 or FUN1 (not shown). The 

25 logic table shows pinO 308 set to 1 during tj which propagates an execution token 

through CALL_FUN1 310. Until FUN1 returns the execution token on FUN1JRET 
312, FUNOJRET 311 and FUN1_RET 312 remain 0 so the output of NOR 
MAIN1_RET 304 remains 0, latching MAIN1H output 303 at 1. This state continues 
until FUN1_RET 312 returns its token at t,, setting MAIN1_RET output 304 to 1 at 

30 t n . On the next tick, this releases MAIN1H output 303 and enables MAIN2, passing 
the main execution token to MAIN2 and MAIN2 output 305 goes to 1 on the next 
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tick, t n+1 . This returns the main execution token over MAIN_RET to the system (not 
shown), drives BUSY_CE output 306 to 1 and sets input "=0" to BUSY, latching a 0 
at BUSY output 307. MAIN is then ready to execute again whenever a new 
execution token is passed to START 300. 

5 

A general description of the device and method of using the present invention 
as well as a preferred embodiment of the present invention has been set forth above. 
One skilled in the art will recognize and be able to practice many changes in many 
aspects of the device and method described above, including variations which fall 
10 within the teachings of this invention. The spirit and scope of the invention should be 
limited only as set forth in the claims which follow. 
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Claims 

What is claimed is: 



1 1. A configurable hardware system for implementing an algorithmic language 

2 program, comprising: 

3 a programmable logic device(PLD); 

4 a hardware resource connectible to said PLD; 

5 a means for configuring said PLD; and 

6 a programmable connection to said PLD. 

1 2. The hardware system of claim 1 wherein said PLD is selected from the 

2 group consisting of an and/or matrix device and a gate array. 

1 3. The hardware system of claim 2 wherein said gate array is selected from 

2 the group consisting of a gate array (GA), a programmable gate array (PGA), a field 

3 programmable gate array (FPGA) and a logical cell array (LCA) device, 

4 and said serial computing device is selected rom the group consisting of a 

5 digital signal processor (DSP) and programmable logic device (PLD). 

1 4. The hardware system of claim 1 wherein said hardware resource is selected 

2 from the group consisting of an SRAM, a DRAM, a ROM, a register, a latch, non- 

3 volatile RAM and ferroelectric memory ROM. 

1 5. The hardware system of claim 1 wherein said programmable I/O bus 

2 further comprises a plurality of lines and means to set a said line to a specific type, 

3 for transmitting signals at a specified voltage with known timing characteristics. 

1 6. The hardware system of claim 1 further comprising 

2 a signal on said programmable I/O bus; 

3 a device in a physical slot; 
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1 a transaction on said programmable I/O bus; and 

2 a means to determine that said transaction is directed to said device in said 

3 physical slot. 

1 7. A extensible processing unit comprising a plurality of interconnected 

2 modules, substantially each module comprising: 

3 a programmable logic device(PLD); 

4 a hardware resource connectible to said PLD; 

5 a means for configuring said PLD; and 

6 a plurality of programmable connections to said PLD. 

1 8. The extensible processing unit of claim 7 further comprising first, second 

2 and third modules wherein 

3 each module is connected to each of the other modules through a first 

4 programmable I/O bus, a module bus, also referred to as an M-bus, 

5 said first module is connected to said second module through a second 

6 programmable I/O bus, a first neighborhood bus, also referred to as an N-bus and 

7 said second module is connected to said third module through a third 

8 programmable I/O bus, a second said N-bus. 

1 9. The extensible processing unit of claim 7 further comprising a first and 

2 second module wherein 

3 each module is connected to the other module through a first programmable 

4 I/O bus, a module bus, also referred to as an M-bus. 

1 10. The extensible processing unit of claim 9 further comprising a third 

2 programmable I/O bus wherein said first module further comprising a bridge module 

3 which is also connected to said third programmable I/O bus, also referred to as an H 

4 BUS, which is further connectible to a host or external processing unit which is not 

5 part of said extensible processing unit. 
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1 11. The extensible processing unit of claim 9 further comprising a plurality of 

2 modules, each module being a distributed processing unit (DPU) comprising 

3 a programmable logic device(PLD); 

4 a hardware resource connectible to said PLD; 

5 a plurality of programmable I/O buses connectible to said PLD, and further 

6 comprising 

7 memory connectible to said PLD, 

8 wherein 

9 each said DPU is connected to a plurality of other DPU units and to a bridge 
10 module through said M-bus. 

1 12. A module designed to the PCMCIA form factor, said module comprising 

2 two generally flat sides as a top and a bottom, 

3 two connectors on said top and tw6 connectors on said bottom, substantially as 

4 shown in Figures 33 and 34, 

5 each said connector having 100 connection locations in a 2 x 50 array with 50 

6 mil spacing, and 

7 pin allocations substantially as shown in Figures 35 and 36. 

1 13. The module of claim 1 wherein over half of the pins are assigned to 

2 reassignable signals. 

1 14. The module of claim 1 wherein essentially every pin for carrying a signal 

2 is programmable. 

1 15. A method of translating source code in an algorithmic language into a 

2 configuration file for implementation on a processing device which supports execution 

3 in place 
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2 



3 



wherein said processing device is a programmable logic device (PLD) 
with an I/O connection and connected storage means for operators and 
connected storage means for data storage, and , 



5 



4 



wherein said PLD is connected to a device selected from the group 
consisting of a CPU, a serial computing device and a memory device. 



1 



16. The method of claim 15 wherein said algorithmic language is selected 



2 from the group consisting of ABCL/1, ACL, Act I, Actor, ADA, ALGOL, Amber, 

3 Andorra-I, APL, AWK, BASIC, BCPL, BLISS, C, C+ + , C*, COBOL, 

4 ConcurrentSmallTalk, EULER, Extended FP, FORTH, FORTRAN, GHC, Id, IF1, 

5 JADE, LEX, Linda, LISP, LSN, Miranda, MODULA-2, OCCAM, Omega, 

6 Orient84/K, PARLOG, PASCAL, pC, PL/C, PL/I, POOL-T, Postscript, PROLOG, 

7 RATFOR, RPG, SAIL, Scheme, SETL, SIMPL, SIMULA, SISAL, Smalltalk, 

8 Smalltalk-80, SNOBOL, SQL, TEX, WATFIV and YACC. 

1 17. The method of claim 16 wherein said algorithmic language is C or a 

2 derivative of C. 

1 18. The method of claim 15 further comprising a support configuration 

2 module including a configuration function, whereby said support configuration 

3 module can provide a plurality of additional functions not available in said algorithmic 

4 language. 

1 19. The method of claim 15 wherein a first said function directs some 

2 program steps to execute on said processing device and some program steps to 

3 execute on said host computer, 

4 wherein a second said function directs some program steps to execute on a 



6 wherein a third said function allows a plurality of program threads to execute 

7 simultaneously, and 



5 DSP, 
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8 wherein a fourth said function allows control of the timing of one or more of 

9 said threads. 

1 20. The method of claim 15 further comprising four sequential phases: 

2 a tokenizing phase; 

3 a token mapping phase; 

4 a logical mapping phase; 

5 a logic optimization phase; and 

6 a device specific mapping phase. 



1 21. The method of claim 20 further comprising translating source code 

2 instructions selected from the group consisting of a C operator, a C expression, 

3 a thread control instruction, an I/O control instruction, and a hardware 

4 implementation instruction. 

1 22. The method of claim 21 wherein said hardware implementation instruction 

2 is selected from the group consisting of pin assignments, handling configurable I/O 

3 buses, communication protocols between devices, clock generation, and host/module 

4 I/O. 

1 23. The method of claim 20 further comprising a stream splitter which selects 

2 source code which can be implemented on an available processing device and source 

3 code which should be implemented on a host computer connected to said processing 

4 unit. 
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Figure 28B 
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CONDITIONAL LOOP 



FOR LOOP 
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WHILE (A = = B) 
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i + + ; 



} 
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function call function definition 
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